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(57) Abstract 

An electronic reading system (30, 3), 32) allows men to download book and other types of contents to a hand-held reader device 
(30) for viewing. Using software which runs on a personal computer (PC) (31), the user can download tines fenn In t er n et sites to the 
PC (31). Talcs are then amonmtienny transferred to the device when the device (30) b pfaced in a cradle (32) which is connected to the 
PC (31X Using the device's touch sensitive display (34) and graphica) user interface, the user can access various software implemented 
features associated with (he display and management f ontffPti 
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WO 99/49383 



■1. 

ELECTRONIC BOOK SYSTEM 



PCT/US99/03I79 



HELD OF THE INVENTION 

The present invention relates to bamWiefd computing tfevses. More particularly, the present invention 
relates to user mterfate and other software features for facitating the viewing and management of informational 
content using a touch-sensitive display. 

BACKGROUND Of THE IWBJTION 

ILS. Patent Appfcatioo No. 09/034,720. f9ed March 4/18% discloses a secure content distraction system 
which enables users to saturefy download Gterary tittas and other types of content to a hand-teld reader device. 
Using the reader device's control bottom and tnsihsaisitwe display, users can perform such tasks as seterting, 
viewing and delating tides, edjustiuj the font size end oriantation of dismayed test and adding notes to selected 
passages. Because the titles are deuanoiated and stored a digital farm, many of the costs associated with the sale 
and distribution of books and other types of printed pAEcations are eMiated, indudittg the costs associated with 
printing, storing and shipping of sucb potOcatont 

tn order for such a system to appeal to tha mass pubfic it b important that the reader device have a user 
interface which is sonpb and btnithre to use. to addition* the device should provide functions which take advantage 
of tha content's digital form, so that users have the attentive to use the system in place of printed (uhfaations. 
Further, the device should he contf ortahb to hold during prolonged viewing session. 

The present invention addresses these end other proMems. 

SUMMARY 

The present invention comprises a handheld computing device that is adapted to he used as a reading 
device for the reading of Bterary tides ami other types of content The device incudes a tosth-sensmva display and 
a graphical user interface that provide various functions associated with the viewing of titles stored in tha device's 
memory. In e preferred emhsdenent the device is adapted to cemmsntcate with a PC or other genera) purpose 
computer via e cradle. 

tn accordance with one aspect of the invention^ the device inptenents an automatic look^m feature which 
can be invoked by the user to look op a word of a Displayed titfe. Using this feature, the user can, for example, 
bring up e definition, bnguage-to-bngnage translation, audible promaca tmn, encyclopedia listing, picture, or other 
type relexence fisting associated with tha displayed term, b one embodiment, the user looks up tha word by tappmg 
tha word twee — once to select the word end a second tsrta to mftiata the look-up process. The device responds 
by searebmg for the word in e pfe*specmed or default reference tide (dictionary, encyclopedia, etcj end displaying 
the results on the display. The reference titles can be downloaded to the device by the user, and can be designated 
for oss with specif tc Gterary tides using the device's user interface. 

In accordance with another aspect of the invention, tha toucrVseasitive display has a toed son displayed 
thereon which represents a usardefi&abtB fonctmn key or "hotkey." Using the hotkey, the user can execute a 
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cammDnfftised menu or sub-menu item (function), nth as a "Set Bookmark Here" function, with a snob touch of 
ttecfopby. Toassr^afunrtinntQlrletot^ 

such as fay touching a "book menu* or •Query rnera" hey. The user to performs an archive drag-aruketeaie 
OBBration from tho hotkey to the target menu item, or vita versa. Thereafter (umD a subsequent reasstgnmantK the 
5 target menu item is eieceted irnmediatery whenever the rjsar toncbss end releases the hotkey with no menu ©splayed 
on the screen. 

tn accordance with another aspect of the invention, the device sttpports a ertattoo rooting feature which 
allows a user to sated a passage on the totBiKsenstrve dfaptay and then designate a destination for the subseauent 
routing of the passage by the general purpose compter, (n a preferred erntmdnnent the usef WtiaDy htghfights the 
10 passage on the display and to taps once oo the passage to bring op a menu of rotrtsrg options. From this menu, 
the user can sefett one or mora resting addressee mdudng emel addresses, far cumbers, fib folders and printers, 
fa addition, the user can type-in aa optional annotation using a pop-op keyboanL 

Once this process is complete, the dense preferably creates a citation fib which indicates the passage and 
destinattonW selected by the user. When a conununications Gnk b subsequently established between the device and 
15 the general purpose computer (such as by placing the dam n the cradle}, the citation fire is automantaDy 
transferred to tha computer (togetho witb any other erratum Res that have been created but not yet transrerred). 
A software application running on tha general purpose computer in- turn routes the passage and optional anno tati on 
to the user-specified dastbattontsL 

Id accordance with another aspect of tha inventJaa the device intrudes an orientation key which can be 
20 touched by the user to bring up four ortaauno markers on tha screen each of which corresponds respectively to 
one of the four posstbte display orientation settings (QL 901 180 or 270 degrees relative to a ban or gripping portion 
of the device). Each of the markers is preferably n tha form of an arrow which points to one of the four edges 
of the display. To select a (fisptay orientation, the user saury touches the arrow that points to the desired top of 
the display. When the user places the device bi tha cradle, the daviee automatrcairy resets tha orientation to the 
25 base (rem degrees) setting to facState the vewoig of content while tha device is in tha cradle. 

BrW OESCKPT10H OF THE DBAWW6S 
These and other features wiD now be descried witb reference to thB drawings surrananzed beiew. These 
drawmgs and the associated descrurtmn are provided to jSnstrate a preferred ernbtidiment of tha mention, and not 
to bruit the scope of the bnntion. 
30 Figure 1 Sustrates tha physical user corrpnents of a content dtstrmution and display system hi accordance 

with the present invention. 

Figure 2 is a perspective view of the hamMiehl reader device of Figure 1. 
Figure 3 is a side view of the device, Sustratmg an ei pan ded base portion that may be used to corrvenientfy 
hold the device m one of four supported orientations. 
35 Figure 4 (frustrates the general software architecture of the system, incfading c om p onent s that may be used 

to securely dstnbute Qterary tubs to users. 
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Figure 5 illustrates the genera) hardware architecture of the device. 

Figures 6 and 7 fflmtrata. a example lorm a hotkey assignment feature of the device's user interface. 

Figure 8 illustrates a sequence of program steps thai ere performed try the device to bnptemeit the hotkey 
assignment feature. 

figures 9 and 10 rJustrate, in eiampie form, a reference thfas feature that enables users to took op 
selected terms within a pre-specified or default reference title. 

Hgure 1 1 Bustrates a sequence of program steps that are performed to implement the reference tides 

feature. 

figures 12 mat 13 Bustrata, in eiampte form, a citations feature that can to used to route a selected 
passage to one or more dsstmatmns. 

figure 14 illustrates a sequence o( program steps that era performed by the device to bu2d a citation fie. 

figure IS ffiustrates a sequence of program steps that are performed by the device to transfer the crtatnm 
lues to the PC. 

figure 16 illustrates a sequence of program steps that are performed by the PC to retrieve, process and 
route the citation files. 

figures 17 and IB ftstrate, in example forra a screen orientation feature of the device. 

Ftgme 1 9 Bustrates a sequence of program steps that are performed by the device to implement the screen 
orientation feature. 

nmnm pgcRynnw of preferred embodiments 

Throughout the foBowhrg description, reference wl ba made to various intptenernatinn-spmftt details, 
mcteting, for eiampte, specific standards that are used bi the computer industry. These dsta3s are provided in order 
to fully set forth a preferred embcolment of the invention, and not to limit the scope of the invention. The scope 
of the invention is set forth in the appended cttns. 
t System Overvww 

Figures 15 Sustrate a content Distribution and (fispby system which incorporates the various features of 
the invention. The system inctodss a haru^ rc^D 
dome for allowing a user to read literary titles {books, journal articles, newspapers, memoranda, eroaSs, etcj and 
other types of content via a touch sensitive (fispby 34. The titles are preferably downloaded to the device 30 in 
digital form from a Persona! Computer (PC) 31 (Figure 1) using a dockmg station or "cradle" 32. Using the device's 
user interface (described balowl a user of the device can perform such tasks as setactmg titles to view, edjnsting 
the font sua end orientation of the displayed text, debting trues from memory, and attaching nous and bookmarks 
to the displayed test. 

b accordance with the invention, various software features are provided tor f acBhating the management 
and display of content using the device's touch sensitive display 34. Prior to describing these features, an overview 
w3 be provided of the general construction and operation of the hand-held device 30 and related components. As 
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wffl be apparent from the f oflowtng disclosure, tha features a! the invention may be incorporated into other types 
of nand-betd computing devices that hove toucrVsensirrfe dispbys. 

At illustrated by figure 2. tha reader davits 30 induces a housing 33 which has respective openings lor 
a toucl«ertirthre dsptay 34* an ON/OfF button 36, and UP and DOWN stroD buttons 3& The bad of the tensing 
(not shown) has as opening formed thereto for tabling a stylus, and includes a muttifin connector 40 (Fbjura 5) for 
common to the cradb 31 Tin tern 3D afro incbdes an audio speaker 44 (figure 5) for outfitting digital audio 
spats, and induces an infrared (IrOA) transceiver 48 (figure 5) for communicating with kiosks, PCs, other infrared 
devices, or another hauHrtd device. 

As fflustrated by figures 2 end 3, the housbg 33 has an increased width and depth and a rounded 
configuration along its base to form an eitended (nipping area 50 for homing the device. Tha gripping area 50 is 
seed to correspond ganeraiy to a typical user's band, and incbdes a curved portion which extends along the back 
sid8 of the device to scaunmodate the user's fingers. As described betaw, the gripping portion is adapted to be used 
to hold the device at nmhipto different device orientations. 

The gripping portion 50 houses one or more elongated, rechargeable batteries 51 (figure 5) thai are used 
to power the device 301 and is thus hearty weighted in comparison to the remaining portions of the device An 
srportaat advantage of this device configuration and weight distribution is that it reduces stress on the user's hands 
and wrists during prolonged reading sessions. This feature, combhsd with the ahity to change this display 
orientation (discussed bebw), facitates (be ebfry for the user to find a t o nrf o rt ab b reading position* 

As depicted by Rgures 1 and 4, the reader device 30 -is adapted to be used as part of a secure content 
distribution system which memoes the PC 31, the cradle 32, and various software componentL ThB cradb 32 pbnjs 
into the serai port (not shown) of tte PC, end also ph^imo a standard power outbt Included within tha content 
distribution system are one or mora dent eppbeatkns which run on tha PC 31. Using these applications, the user 
can purchase and download literary titles (novels, textbooks, journal a/tides, etcj from Internet and other network 
sites to the PC, and subseu^try transfer tfiesitrtfes to the device 30 for viewing. The device 30 may adoltionaQy 
or alternatively be provided with browser software and a modem for allowing the user to download tides to tha 
device directly. Titles may additionally or alternatively be retrieved by the PC from a physical storage medium, such 
as CD-ROBfl or a DVD dot 

One type of PC application, which may be in the form of a browser plug -in, provides functionally for 
allowing a user to interettireiy purchase and download tides from Web sues. The PC 31 may abo ran a dent 
appficetbn which retrieves free and/or subscription titles automatically (such as by raplemanting a "push* protocol) 
from network sites based en pro-specified preferences or subscription profibs of the user. 

ftesanflase of lire type of title retftml methnd osadl tfan vitles that are itored on tha PC 31 are pref erabrr 
aotcroatica&y transferred to the device 30 when tha device a placed in the c/adb 52. The software ruomng en the 
PC may additionally or ehemathrery be configured to aSow tha user to initiate titta transfers manually. The c/adb 
52 abo acts as a chargmg station for automatically charging the device's batteries. 
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Ia oas intplsnsniatton. ths device's software supports both tha US ASCI) and the Unicode character 
encoding standards. Tin use of Unicode aEmws ths device to bo used to display bttss of rnuttiple different written 
languages. Tha device b also capable of displaying graphics onager sod playing sound dips, that ore embedded 
wrthra ths titles. The system software also supports standard markup languages such as HTML (HypsrText Markup 
language!, sod supports tha use of fyperfiaks to navigate within and batwean titles. 

to ona erobotfunaflt tha device includes a speech synthesizer epphcaiion which converts encoded teit (ASCII 
Unicode, etcj into audibta speech. Using this appfcation, a user can Bsten to a selected titJa. Tha speech 
synthssiiai application is prefe/aWy configured to automatically scrofl and highlight tha test on tha display 34 in 
synchronism with tha aodSda output so that (ha sser can optional? "foOuw along" with tha synthesized speech. 
Tha f eature may faa used, for eiampta, to assist ths oser to teaming a naw language or to assist tha visitifrcnpairEi 

frtbs may optionaOy ha downloaded from Internet sites and transferred to tha device 30 in an encrypted 
form, in which case the encrypted titfas are deoypted by tha device "en-the-fly" ss the titles are viewed. Preferably, 
the titles are encrypted (tymcaDv by server software running on 8 Web site) using a pubfic key that corresponds 
uniquely to a particular device 30 or the user, and are decrypted using a private key which is stored within tha 
device. When the user purchases bji encrypted titta, the user identifies the device to the network site using a unigue 
identifier, and does not need to know [and does not have access to) the private key. This astroufjon method 
protects tha content from being ac c e ss ed by unauthorized users. 

In ona embodiment, two sets of pssGc/privste key combinations or "certificates* are used. The first 
certificate is assigned in ths factory during the maanfectunng process and is caSed the "Device Certificate. 11 The 
Device Certificate corresponds to a particular device 30 and allows a key adrnimstration entity to have a protected 
conversation with the device. The second certificate is assvjned and downloaded to tha device during the user 
registration process and is catod the "User Certificate." The User Certificate foflows ths particular user fLe* can 
be transferred from one device to anotherL and is used to encrypt and decrypt titles. This approach allows the user 
to upgrade and/or replace the physical device 30 without losing access to existing titles that have been encrypted 
for the user. 

figure 4 Bbstrates the general software ai it fteaui a of tha reader device and associated PC software, end 
also illustrates the general servo architecture of a secure content distribution system Additional details of the 
secure con tarn Distribution system are provided in US. AppL No. 091034,720, Bed March 4, 1998. the msctosure 
of which is hereby incorporated by reference b its entirety. 

As depkted by Rguie 5, tte device 30 is co^ 
three typo of memory: an EPHOM 66, a FIA$H array 88, end a ORAM array 70. The EPROH 60 is used primarily 
to store system software used during initta! boot-up, along with certain security keys. The FLASH array 66 is used 
prtmariry to store system software, tha user and dance keys, titles and software applications. Titles that are 
downloaded to the device in encrypted and/or compressed form ere rnamtamed in such form in FLASH memory, and 
are written to ORAM as they are decrypted and decompressed lor viewing. Other details of the hardware 
architecture are set forth cn the above*ef ereued appfeatmn. 
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The device 30 preferably operate* under the control of a proprietary operating system developed by 
AtoroMema lot, but may alternatively operate, for example, under the control of the toanlows CE* operating system 
from Microsoft Corporation. The PC applications run under the Microsoft Widows 9 family of operating systems, 
bat may be adapted to run on Mac OS, Unix, and other platforms. 
5 With reference to F^um 2 and Uie davico's tooctVseosftnra ifisiday 34 mdodes a touchscreen 74 wfncb 

is mounted on top of an LCD display 76 {the perimeter of which is denoted by 76A o Figure 21 The LCD display 
76 b equipped with a bactfgbt (not shown) which can be tamed OM and OFF osmg the power button 36. The 
tooth screen 74 extends to or sfzQhtry beyond the inward-lacing ease 76 of the device's bezel tn one 
implementation, the torch screen 74 b a Panasonic EMU601A2N400 darks. 

10 

IL ftreryjaw q| foer. fffierffifl 

As ffluslrated by Figure I tha portion of the touch screen 74 which extends beyond the pereneter 76A of 
the LCD display 76 has four fixed icons mspbyed thereon to form four respective function keys: en orientation key 
80, a user-definable "hotkey" 82. a book mem key 84, and a Unary mens key 86. Each icon is m the form of an 
1 5 orientatiim4m1ep6ndant image that conveys meenhg regardless of the orientation m which the device is bang held. 
For example, in say of the f oar possible devse the orientates, the orientation son 80 appears as a pane of text 
that b being rotated 

When the orientation key 80 b louched, the device displays four arrows (ripe 27), each of which can 
be touched to select one of four possible display orientations (0, SO, 180 or 270 degrees retathe to the base 50 

20 ol the device). Using thb feature, tha user can select a text orientation which corresponds to tha user's preferred 
device orientation end gripping method. For exampte, a teft*handed user may choose the deviceftext orientation in 
which the gripping area 50 fab on the left-band side of the device (as in Figure 61 and a right-banded user may 
choose the opposite orientation. The combination of the weight-concentrated grqtpmg area 50 and the abffity to 
change the display orientation allows tha device to be osed in multiple efferent orientations without sacrificing 

25 comfort The screen orientation features of the device ere discussed further below. 

When the user touches the hotkey 62, the device 30 perforins a function (the "hotkey function*) that b 
currently assigned to the hotkey 82. As descrmed separately below with reference to Figures 6*8, one aspect of 
the invention b a user interface feature which stows a user to rapidly and mtuitively designate the hotkey function. 
When the user presses the bosk mena key 64 or the Ovary meno key 86, the device 30 Displays a book 

30 meno 85 [Figure 6) or e Ebrery mens (not shownL respectively. Tha book mesa 85 intfades various nremi items 
which pertain generally to tha tftb that b anremfy being viewed. The Stray menu contains menu items which 
pertain generafiy to the library of fterary titles that are currently stored within the device 30. The menu and sub- 
menu items of the book and library menus are (bled end summarized in Table 1. 
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| Menu hen 


uescnpnoD 


Book Meau/Highfigbt 


Topjbs mode which allows user to tooth words. Goes and 
paragraphs to pennaneniiT ntgragiti tnem. 


Book Menu/large Text 


Toggles page (fisslay between norma) and large fonts. 


Book Menu/Add Note 


Causes a user note to be attached to the selected test or if 
no test is selected, to the current pap. 


Book MfimifSfit Bnokmak Ken 


Sets a bookmark to the selected text, or if no text is 
steed, to the current page. The fust few words of the 
sanction are used es the default idortffier of the bookmark. 


Book MenujGolo Bookmarks 


Displays a Est of the bookmarks for the titfa, indodbtg both 
bookmarks derated by thepobfisher (sucn as Index* and 
"table of contents*) and bookmarks defined by the user. 
From this fist, the user can either goto or delete a displayed 
bookmark. 


Book Menu/Search 


Displays 8 submenu of search options (see betowL 


9 Book Meou/Search/lockttp 


Searches the displayed life f or a text strwg. The string can 
be selected before invoking this function, or can be entered 
unag a pop^p keyboard. 


9 Book MsnufSeardtTotber tegs" 


Takes the user to the pubSsher-defined tags. These tags are 
incorporated into the Search menu automatically. 


J Book Menu/Set References 


Abws the user to designate one or more reference tides to 
to used in place of a fefatdt reference tide. 


library MsnofBooksfasff 


Displays of fist of the tittes currently stored on the device. 
From this fist the user can delete titles or select a title for 
reading. 


library Memt/Oesk Supplies 


Displays a fist of additional programs available on the device. 


Library Menu/Set Citation Destinations 


Allows user to create Gets of destinations (email addresses, 
fax numbers, etcj for tontatg selected passages. The 
destination fists can ettarnabvely be generated on the PC and 
transferred to the device. 


lArary fitonuTtitb* 


The library menu always tfispfays the four most recently osed 
literary tittes. Torching e title wl cense the title to be 



TABLE 1 



in. Assignment of Hotkey function 
20 The rmtie? function can be any of ttamerra When the hotkey 82 is touched end 

released, the device 30 executes this function. The hotkey feature thus allows e user to quickfy invoke a commonly 
used menu or sub-menu function with a xngk touch of the screen. 
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Whh reference to Figure 6, the menu or sub-menu item that it currently defined as the hotkey function a 
denoted as «ch by a hotkey icon SO. to this exempli the hotkey iton 90 appears next to the 'Goto Bookmarks* 
item of the book menu. With this hotkey assignment the device & wfl display a fin of bookmarks when the 
hotkey 82 is toothed if the current hotkey function has a sutHnenu associated with it touching and releasing the 
hotkey 82 w3 causa this sub-menu to bo displayed. 

An ermortant feature of the device is a user interface method for allowing the user to define the hotkey 
function using en intuitive drag-aiukebasa tethniquB. This method is 3ustrated in examon) form by Figures 6 and 
7. With reference to Figaro 81 the user initially brings up the meno or sub-menu that contains tha target hotkey 
function. As depicted by Figure 7, the user than touches the hotkey 82 whh tha stytas 82 for tha user's fiogerL 
drags the stylus to the target item and than removes the stylus from the touch screen 74. 

During the dragging process, the hotkey icon 90 is displayed next to the menu item & any) that is currently 
touched, to Figure 7, for example, the hotkey icon 80 is displayed nasi to the 'Highlight* item since the stylus 92 
is currently over that item. This feature allows the user to reatfy identify the item that will be assigned as the 
hotkey function when tha stylus 92 is lifted from tha screen. The selected item may a&Stronafy or alternatively 
be displayed in a highSghted form, a a&fitioa e shadowed, grayed or other representation of the hotkey icon may 
f oBow the stytus tip during the draggmg process. 

If t during tha dragging protest the stylus is moved away from tha menu 85, tha hotkey Icon either (a) re- 
appears next to the currentry-osagned hotkey function 0 this function appears in tha Displayed menu), or (b) 
disappears from tha display fjf tha ciirreotry-assigned hotkey function does not appear in the displayed menu). K the 
stylus 92 b not over a menu hem what the stylus is withdrawn from tha screen 74, the prior hotkey assignment 
remains in effect 

fa other mtfememetoas, the device 3) may adtStiooaly or alternatively ba configured to allow the user 
to assign tha hotkey function by dragging and dropping the target menu item onto the hotkey 82. Whh this 
attematrve method, tha user touches the menu item, dregs the item across tha screen 74 to the hotkey 82 (during 
which a shadowed or dulled representation of the item preferably moves across tha screen whh tha stytol and than 
removes tha stytus from tha screen. The hotkey seen 90 b then displayed next to tha mm} item to indicate that 
the operation was successful In mfa&tioit alttoigb tha hotter 82 In tf» praf »ml einbodiriiesn is a f iicil boo on 
the touch screen 74, the above method can alu be used to asssja a function to an dectr'onkaOy-disptayed hotkey. 

Figure 8 b a flow (Digram of a software routine that is used to onphsnent the Figure 7 tecfauQoa. This 
routine is invoked when rhe hotkey 82 n tnitiafly touthei As represented by steps 100-104, H no mam is open 
when tha hotkey is touched, tha program waits for tha user to 6ft op from the screen and then executes tha current 
hotkey function. If, on tha other band, me or more menus are currently open, the program enters otto e hotkey 
assignment sequence (steps 108-114). 

hi step 106, the program determines whether tha touched area is over a meno hem. If it is, and the 
touched menu hem ts not currently marked with tha hotkey icon, tha hotkey icon is moved to tha touched hern (step 
1081 if it » not and the current hotkey item b not marked, the hotkey icon is moved to the current hotkey hem 
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(step 1101 which nay or may not be displayed on tin screen As indicated by steps 112 and 114, this proms 
is continued umfl the user ifo up on the screen, at which time the marked menu item is set as the current hotkey 
function. 

As indicated above, the program may addrtionely or atoernativefy support drspj&g and dropping the menu 
S item to the hotkey, to addition b oim emhoibjn^ 

<£rectty from one item to another item that appears n the seme meno or submenu. 

fV. Reference rates 

Another important feature ombres the entity irf the user to took up a word or pmase using a default or 

10 pre*petified reference title. This feature of the device is itostrated in figures 9. 10 and 11, which demonstrate 
the use of the feature to look up a translation of a selected term. 

As depicted by Rgura S. the user bm^ setectt the tenn by tapping it once. H the user then taps the 
selected term a second tons, a sequence of steps is initiated m which ma device attempts to bcata aa appropriate 
reference title, end 9 one is found, searches for the selected temi If a reference titb is rotated, a pop-up window 

15 130 (Figure 101 is used to (fispby the rssuftsof the search. H no reference title is found, a pop-up window appears 
which displays as error message, such as a message which gives tha user the option of designating a reference title 
for the title being viewed. 

In addition to stchnfing textual results, a reference tree may tnctuda graphical images that am displayed in 
the poiHip window 130, and/or audio search resstts that are played back on tha speaker. For wampla, a dictionary 

20 reference titb may mcmdfi atnfibfe pcmmciatsns that are played back concurrently with the Display of the definition, 
or that are played back if tha user taps the look-op term within tha pop-up window 1301 in other embodiments, 
tha device 30 may be capable of playing back video and rmdrimema dips that are stored within tha reference titles. 
To enable tha search software to tiscrbninate between the look-up terms and the associated content [Definitions, 
audio, etc), the look-up terms are tagged within the reference title document as keywords. 

25 As with Bterary titles, reference titles ("references") can be retrieved using the FC and downloaded to the 

device 30, and many different references can reside on the device concurrently. Eiamptes of the different types ef 
references that can be used isctate fogmstk (fetionaries, tannuage-to-fcssmjage tictsmsries, dictionaries specific to 
a given technical fold (e-g* meuomal encyclopedias, and thasauruses. Using appropriate software which rem on 
the PC, the user may aba ha provided the option of creating a "custom" reference to be downloaded to the device 

3D 30. 

The reference fur a given ftereTy title can be designated by the user using the "Set References* menu hem 
(Table 1) of the book mem If no reference has been designated for the tine when the look-up is initiated, the 
device 30 attempts to locate a default reference using various classification tags that are embedded within the 
literary and reference titles. These tags may mdode, for eiampfe, a language tag which imfoates the title's prenary 
35 language, and a category tag which mercetes any special category or categories that the title falls within (04* 
medicine, physics* efectnnncs, bw # ettl 
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tn the preferred embodiment, the referstcd titfas and the torary tftles are downloaded are stored separately 
from one another, in other (ronlernsfflatioQS, ths two types of titles caa alternatively be combined within a snob 
title. For ei ample, a oubfisfaer could se§ an etectrsmcs textkoek which has one or more corresponding reference tides 
embedded the rem* 

5 to one embodiment, the user can designate primary and secondary references for a given tide, The device 

30 wffl then search the secondary ref erenre (or references) cnfy H ra match b f cam) In the primary reference, The 
device may also he configured to jump directly to the secondary reference (rather than initially searching the primary 
reference) when the user preforms e specific action, such es tappmg on the term three times m rapid successors 
Using this feature, a oser could, for example, set op the device such that tapping on the word twice brings up a 

10 octmnary defmitmn whse moping on the term three times brings op a transfatmn or audfole pnnmnciation. 

Figure 11 iterates one erntedartent of a software routnw wtecb tan be used to implement the look-op 
feature depicted in Figures 9 and 10. The routmeb onroked when the oser taps twice en a word of a fiterery titte 
(once to setect the word, asd a second tins to Initiate the search). As represented by step 140, the program DiuaBy 
determines whether a special Terence bwbeeo designated f or the title, and 3 so, whether the reference is present 

15 in memory. A special reference may be designated either by the prfrSsher or by the oser, and may be specified 
within the literary title using a special tap. 

If no special reference is located, tha program begins to search for an appropriate default reference. In 
this example, the program first checks the trdes's category tag & any) and searches for e reference that corresponds 
to the tmVs category (step 142). If muftipJe matching references are found, the user may be prompted to designate 

20 one of the references es a default for that category. If no category-based reference can ba found, the program 
checks tha language tag (if 8ny ) of the tide and searches for a correspomfing bngnage-based reference (step 144). 
U muttipte language-based references are found, the user may be prompted to setect e default reference to be used 
for that language. 

As depicted by steps 143-152, once a reference has been found, the program opens the reference and 
25 searches for the selected term as a reference keyword. As part of tins step, the program mraafly determines 
whether the reference is marked as being ordered afchabeticaSy. and if so, performs tha search as a binary keyword 
search or other such search techmoue, The results of the search (tefmrrM "not foumf message, etcj ere dtspJayed 
n tha pop-up window 1301 which is cleared open sobswiiwnt oser activity. 

As depicted by step 154* an appropriate error massage is displayed 3 oo reference is found. 

30 

V. Selection end Routhm of Content 

Another enponam feature of the reader device 3) that it alows the oser to define a *dtatton* which 
includes one or mere passages from a displayed tine, and then specify one or mare destinations addresses lamed 
addresses, fax rmmbers, printers, etc.) for routing the citation. When tha user sutrseouentfy establishes a 
35 lornnionitaiiom Bnk between the PC and the reader darice 30 (such as by plating tto dsvira in the eradte 321 any 
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citansns that have been defined by the user era eutomatsaOy upbaied to the PC, and a utity running on the PC 
automatically routes the stations to the sperinsd destinations. 

Tan feature of the mvention e abistrated in Btampte form by Figures 12 and 13. As ifostrated by figure 
12, the user mtiafh/ uses the stybs to bbck a segment 160 of content, which in the Figure 12 exampte consists 
5 of one paragraph of text tn a preferred embotfinent the device supports severs) different methods for blocking text, 
any of which can be used for this purpose. For example, through appropriate menu* the user can configure the 
device such that tapping anywhere on a paragraph causes the entire paragraph to be selected, or such that tapping 
on a sentence causes the sentence to be selected The user can anemativeh/ use a teetb-anddrag method to select 
the passage. 

10 With reference to Figure 13, tha user can then tap once on the selected pissage 160 to farmg tip a dialog 

box 161 11 tha user then selects the "Add Annotation* item a pi (Hip keyboard (not shown) and editing screen are 
displayed for allowing the user to type is an annotation. The user may also be presented whh the option of adding 
adtfitional passages to the citation. 

As illustrated in figure 13, the dbbg box 162 includes a Est of the categories of destinations that can be 

15 selected for routing the citation, fn the preferred embodiment, the user can route the citation to a printer, a fte 
cabinet or folder object on the PC, an etnas' address, a fax machine, or a cumbinaticn thereof. When the user taps 
on one of these destination categories, the device either marts the destination category type as selected Gf erdy one 
predefined destination exists for that category I or displays a 1st of the destinations thai exist for that category Of 
mufnpie destinations have been defined). For exampfa; the user can select the "To EmaT category, and then select 

M ena or more eraafl aduVesses from a persona) address book. 

Once aO of the destinations hare been specified and any annotation has been typed in, the user taps the 
OK button to complete the citation definition process. The device then uses the information specmsd by the user 
to btriM a citation fib to be transferred to the PC. The citation fib is preferably created such that the original 
formatting (font size, appearance, etcj of tha text is preserved. 

25 Figure 14 ftatrates a program sequence that may be used to generate an HTML citation fie. It wi be 

appreciated that other markup languages and/or He formats could aheraativBry be used As depicted by Figure 14, 
tha program creates tha citation f Be (step 1701 and then inserts into tbe fee the f oBowing etementc a header with 
tha user-specified destination^ 172L HTML start and end tags (steps 174 and 18a any annotation 

typed n by tha user (step 1 75), any HTML formatting tags in effect at the start of the passage (step 1 761 pointers 

30 to the start and end of the passage (step 1781 end appficabb tags specifying the title, author, pub&tber, and date 
of the tits and the chapter and verse of tha passage (step 1801 Tha fib is then dosed 1184), and is thereafter 
mamtamed m memory unti it is either successfully transferred to tha PC or dented by the user. 

Step 176 (inserting HTML formatting tags in effect) invokes searching the text which precedes the passage 
to identify any for matting tags that anpfy to the passage. The purpose of this step is to preserve the passage's 

35 formatting. For example, if the passage consists ol the second sentence of a paragraph which is in bob) and itafici 
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this stflpwffliesuft BiboMandiiafittt8|Mb8fl^idiy to the fa (just before the passage) to that these tonnattmg 
attributes are preserved. 

Step 178 (adtfirtg pomtertl a psrformsd a foo of copyag the passage <mr to the fSa. The purpose of tim 
step is to conserve memory. When tba dtatioa f& a bte/ transferred to the PC. the pointers are replaced with the 
5 actual content of the passage. One potential problem with this approach b that the user may delate the trtb before 
the citation fie is transfened to the PC. One method for avoiding this problem is to block the fib from being delated 
until the citation fie has been transferred. Another method is to autoanaticafly copy the passage over to the citation 
fib whan the tttb is selected for debttoa. 

When tha user pieces the reader device 30 fa the crafle 32, or otherwise establishes a communications fink 
10 between the device and the PC (such as vb the infrared port or a modeml tha PC seads a request to the device 
(assnmng the associated PC appScatjsn b running) for any new citation fibs that have bean created. As depicted 
by Figure 15, the device responds to the request (assuming ens or more citation fibs have been created) by inserting 
the referenced passages into the otatmo fibs (step 19DK transf erring the citation titles to the PC tstep 192L aod 
waiting (tor a timeout period) for routing confirmations from the PC tstep 194). As depicted by steps 198-202, tha 
1 5 device then deletes any fees that are ccirfirrned, and dbpbys an error message if less than afl of the citation fries 
are confirmed. 

Figure 1 6 Illustrates a program that is executed ort the PC when the reader device 30 b initially detected 
within the cradb, with emphasis on the steps that are performed to retrieve and route the citation files. As 
represented by steps 212 and 214, (he program brrjaPf queries the device to determine whether any new citation 

20 fifes have been create! If no citation foes exist the program immediate ty performs other housekeeping tasks (step 
226). such as downbadfog any new titles to the device 3d 

If one or more citation fibs exist the program inmates a transfer of the citation fibs to the PC (step 21 61 
For each citation fife the program straps off the header (step 220), routes the citation to the appropriate 
destinatioots) (step 2221 and returns a routing confwmaiisn rnaiiaga to the device tstep 224). As represented by 

25 steps 222A-0, citation ties that are addressed to a folder are copied by the program to that folder; and crtetioo fibs 
that are routed to a printer, fax manner or emaS address ere routed using the respective operating, system (OS) API 
(appScation program interface) of the Wndows 9 or other operating system. Once afl of the citation fibs have been 
routed, tha program frames the other housekeeping tasks (steps 226 end 228X 

30 VI Screen Oriam;fljmj 

The screen orientation features winowba descried b further dated with reference to Figures 17-19. 
As Sustrated by Figure 17, pressing the orientation key 60 causes four graphical orientation markers 240* 
248 to be superimposed over the rfispbyed text adjacent to respective edges of the display. The markers 240-246 
are mine form of arrows which point to the four respective edges of the dbpby, with each arrow repieseotmg one 
35 of the four possbb display orientation settings. The marker that corresponds to the current salting (240 in this 
example) b shown in a highlighted form. 
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To select a raw orientation setting, ths user taps the marker that posits to iha deseed to edge of the 
display. Ibis causes the device to dear the marten end repaint the displayed text osng the new orientation Of 
different from the current orientatM For eiampta, if ths user taps on arrow 246 m Figure 17. the test wfl) he 
redisplayed with the orientation shown b Figure 18. This feature of the device aflows the user to omckfy (with only 
two taps) and rnmhrvety setoct a display orientation that corresponds to the user's device anenteral) preference. 

An onponam aspect of this method is that it does out involve the use of textual menu items or other 
orientation-specific controls. As a result, there b no Dnpadtaem to pfaring the device in the desired physsal 
orientation prior to adjusting the ajspfay orientation. Thus, for example, the user can adjust the orientation es 
fouows: toitiaDy, the user can experiment with muftipfe different device orientarJons and gripping methods unti a 
ccmf ortabfe position is found. Once soch a position a found, the user can simply touch the orrarttatsrHrufepeadent 
rotation icon 80 and then select the arrow that paints to the top of the screen. 

This method provides significant advantages over meno-based methods for adjusting the display orientation, 
such as the method used by tha Appb Newton™ PDA devia. With the Newton dewca, the user selects one of the 
three folio wing poss&b display rotation options from a drop down menu: (a) a counter-dock woe arrow together with 
tha word "toft" (h) a clockwise arrow together with the word "ripht,* or fc) t relatively hmg dechnse arrow 
together with the term '180°.' One problem with the Newton method is that it essentially requires the user to hold 
the device m ths "original" orientation (to maintain the readability of the dropdown menu) as tha display orientation 
is adjusted. Another probten is that the user must rrmmaDy identify and then sefect the display rotation optmn that 
corresponds to the planned device rotation. The present method of adjusting the display orientation overcomes these 
rmtftatrens. 

Figure 19 Bustrates the steps that are performed when the user touches the orientation key 80. The 
program tnhia&y superimposes the orientation markers en the screen as in Frgure 17 (step 25% and then waits unti 
one of the markers is touched (step 2S2L Upon detecting such i touch event the program clean tha display, 
repaints the display using the selected orientation setting, and records the setting in memory (steps 256 and 258). 

Another feature of the reader device 30 is that h amomaticauy resets tha orientation to the base setting 
(as in Figure 18) when the device is placed b the cradle 32. This facffitates the viewing of information wide the 
device is to tha cradk h one emtodiment the reader device can be configured by the user to automatically return 
tha orientation to its pmtradta setting upon removal of the device from the cnufla. 

Tha device 30 preferably detects that rt has been placed m or removed from the cradb 32 by a sensing 
a grounded pin on the cradle. Upon detecting the grounded ph, the device 30 executes a service routine tfiB records 
the correal orientation setting and then resets the orientation to tha base setting. A srrnsar routme may be eiecutetf 
upon removal of tha device from tha cradle to restore the orientation to tha prior setting. 

Although this invention has been described in terms of certain preferred embodimerjts, other embodiments 
that are apparent to those of ordinary stffl In the art are aba within the scope of this invention, Accmomgry, the 
scopa of the present invention is attended to be defined only by reference to the appended claims. In tha chums 
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which follow, reference characters used to designate claim steps are provided for convenience of description crfy, 
and era not intemted to imply any particvtsr order for pert oraimj the steps. 
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WAT IS CLAIMED ft 

I. A band-held computing device that b adapted to be used by a user to read literary works, the 
device comprising: 

a housing which supports a processor, memory, and a totttb-senative display; and 
5 a phirafity of titles stored within the memory, the plurality ol titles mdaomg at least ana fiterary 

thte that is adapted to be viewed en the (fapby as a fiterary work, and at bast one reference tide that 
is adapted to be used as a ref erenca work; 

wherein the processor is uioyaana d to respond to user selection of a displayed term of a fiterary 
titb for look-up by performing at (east the following steps 
10 (a) identifying a reference title that corresponds to the fiterary title; 

(b) searching ins reference title identified in step (a) for the displayed terra; and 

(c) displaying restdts of the search in step (b) on the touca-seositiva dispfay. 

t The band-held computing device according to Cta 1, wherein the reference titte identified in step 
(a) is a tanguage-to-tenguaga translator, and step (c) comprises tisjriaying a translation of the displayed term on the 
15 tonch-sensinvB Display. 

1 The handheld computing device according to Ctain 1, further compnshg an audio speaker ccup&d 
to tba processor, and wherein step U) farther comprises ootpnttmg aod3rte search resorts on the speaker. 

4. The tiand^ computing device acconfing to Claim 3, wherein the auelte search results include 
an audtte prommdatoui of tha displayed term. 
20 5. The band-hsU computing device according to Ctam I, wherein the processor enptenems a user 

interface which includes a mano option for stowing a oser to designate a specific reference title to be used with 
a given fiterary title, and wherein step (a) comprises identifying a reference title that has been designated by the 
user. 

b\ The band-bald cempmmg device acconfing to darn 1, wherein step ft) comprises searching for 
25 the term within the reference tide as a keyword, 

7. The handJietd corqnitmg device eccenfog to Claim 1, further ctrmpmmg soitware for downtoadnig 
reference titles to the memory. 

8. Tba bamWield computing device aetoroatg to Ctain 1, wherein the processor is programmed to 
perform steps (sHc) in response to a oser tapping on tha (fspkryed term. 

3D 9. The hamUrcU computing device according to Clean 8, wherein tha processor is programmed to 

perform steps (aMc) in response to the user tapping twice in succession on tha displayed term. 

10. The hand-held competing device according to Claim 1, wherein the reference trite and the fiterary 
title are stored within a smgte 19b* 

I I. The handheld computing device according to Oaks 1 in combination with a cradle and a software 
35 appfication, the cradle adapted to receive the handheld device to dectricaBy couple tha device to a general purpose 

computer, the appfication adapted to transfer works, inctafing fiterary and reference works, to the hand-held device. 



WO 99/49383 PCT/US99/Q3179 

16- 

12. in a bauMieM computing device thai is adapted to ba used to read rnerary works, a method of 
facffitatng the comprehension of a fiterary work, the method comprising tho ccrnputBf-iraptenjEDted steps oh 

la) (fispfeying tbeBmanr wark totteoor ooa toocb-ssnshivB tfispby of tha device, the 
literary work stored hi a memory of (ha device n a digital form; 

(b) in response to oser setectbo of a displayed term of the fiterary work for tootep, 
searching for the term in a reference wort tha reference work stored m the memory of the device n a 
digital form; and 

(c) (fisptaying search results from step (b) on tha teuch-seiisithra display. 

11 The mathod of Chmi 12, vrfaarest a pturaBty of rafeence works are stored tn ttts msnory of tha 
device, and tha method further comprising identifying a reference work that corresponds to the fiterary title. 

14. The method of Claim 12, wherein the reference work is a languag e-to-fenguage traosfetflr, and step 
(d comprises displaying a translation of the displayed term en tha touch-sensitive display* 

15. The method of Claim 12. wherein tbe reference title comprises an audio cap which is stored in 
assodaton with the term and step.(c) further comprises audibly cutpotting the audio dip on a speaker of tha 
computing device. 

16. The method of Claim \7, wherein the step of outputrjng comprises generating an audible 
pronunciation of tha displayed term* 

17. m a band-held computing device, a method of routing a citation to a destination, the method 
comprising tho ccmpoternrnplemented steps oh 

(a) displaying a title to a oser on a tctrch-sansmve msplay of tha hand-held compsting devita, the 
titte stored in the memory of the device in digital form; 

(b) m response to user selection of a citation from tha title and at least one routing address, 
storing a data record within the memory, tha data record representing the citation and tha routing address; 
and 

(c) transferring tha citation and tha routing address to a general purpose computer that is 
programmed to route tha citation based on tbe routing address. 

18. The method of Claim 17, wherein step (d is performed automaticaHy when a carnmunications fink 
b established between the band-held device and tho general purpose computer. 

1 9. The method of Claim 17, wherein staple) is performed amomaticaSy when the hand-held device 
is placed in a cradle that is connected to the general purpose computer. 

2d The method of Claim 19, wherein step (c) comprises transferring a ptura&ty ol citations and a 
plurality of routing addresses to the general purpose computer. 

21. The method of Claim 17. wherein step (4 comprises routing the citation to at least one of an 
emea address, a facssmm number, a printer, and a tHa folder. 
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22. ' Tha method of Claim 17, further comprises (fispfeying. a dialog boi on the copby, the cfiatog boi 
prompting 8 user to select one or more destoiatnjis. 

21 The method of Claim 1 7. whereto step (M further comprises adding aa annotattoo entered by the 
5 user to the data record, and step (4 comprises transferring the annotatmo to the general purpose computer. 

24. The method of Qasn 17, wherein step 84 further comprises! 

adding beginning and ending markup language tags to the data record: and 

adifing markup language formatting tags in effect at the start of the cstdlton to the data record. 

25. Tha method of Ctakn 17, tarhsren step (b) further comprises automatically adding to tha data 
10 record a tag that identifies the title. 

26. Tha method of Cfeiro 17. vrherea the step of storing comprises storing pointers to a start and 
end of the citation in the data record. 

27. The method of Class 17, wherem step (a) comprises dtsptaying a book title on tha touch-sensitive 
display, tha book titte stored in the memory in an encrypted form 

15 28. A general purpose computer having a cradle connected thereto* the cradle adapted to receive a 

hand-held computing device, the general purpose computer brag a processor programmed to receive and route 
citations stored within a memory of the hand-heft) device by performing at least the following steps: 

(a) detecting the presence of tha handteM casputmg devils in the cradle; 

(b) automatica&y receiving a {durafiry of citations and a plurality of destination addresses from 
20 the hand-tehf computing devce via the cradle: and 

4d aeicmaticafly routing the citations to destinations specified by the destination addresses. 

29. A hartd-hetd computing device; comprising 

a boosing which supports a processor, memory, and a touch-sensitive display, the touch- sensitive 
display having an icon Displayed thereon, the icon representing a user-definable function key; and 
25 user interface code stored m the memory and adapted to be executed by the processor, the user 

interface code providing at bast one menu, the at feast one menu including menu items that can he selected 
for execution by the user by touching cow upending portions ol the touch-sensitive display, the user 
interface code further including: 

function key execution code which executes e menu item that is currently assigned to 
30 the function key when the user touches and releases lbs function key; and 

function key assignment code which assigns a new menu item to the f uncusa key when 
tha user performs a drag-ond* etease operation on the touch-sensitive airplay between the icon end 
the new menu hem. 

30. The band-held computing device according to Ctasn 29. wherem the function key assignment code 
35 assigns s new menu item to the function key when tha user performs a drag-end-release operation from the icon 

to the new menu item. 
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31. Tba haatf-held competing tfsnce according to Claim 30, wherein the function key assignment code 
ratiaOy narks a currently touched mens item on tba touch*sensitnre display during the drag-end-refease opsration.to 
enable the user to raoa&y conf bra a mora item being touched. 

32. Tba band-held computing device according to Claim 29, wherein the function key as^unant code 
5 assigns a new mean item to the function key when the user performs a drao/aneVretease operation fnna the new 

menu item to the icon. 

31 The hand-held computing device according to Claim 29, where* tba icon is fixedly displayed on 
the touch-sensitive display. 

34. The hand-held cooiputing device ucemding to Clann 29, where© the function key eiaxotrofl coda 
10 executes tba menu item currently assisted to tba function key only if no menu b open en the display when the 

function key is touched. 

35. The hamMteJd computing device according to Claim 29, wherein the memory indbdes system code 
stored therein for aJmwing the user to download encrypted literary titles to the memory and to select individual 
literary titles for viewing. 

15 38. The hand-bald computing device according to Cfaen 29, wherein ths btmshg atbdes a griping 

portion formed along ooo edge of the toucksenstrive display, end the user interface code provides an option for 
allowing the user to select a display orientation which corresponds to the user's preference for gripping the device. 

37. The hand-held computing device according to Ctesra 35, m combination with a cradb that is 
adapted to receive the device and interconnect the device with a general purpose computer, wherein the user 

20 interface code is adapted to automatitaSy set the dismay orientation to a base setting in response to placement of 
the device m tba cradb, the base setting fariitatmg the viewing of content with the device in the crams. 

38. Ametrmdoffaci&atingtte 

sensitive display of a band-held computing device, the toucb^sensitrve display having four edges, the method 
comprising: 

25 providing an orientation key which comprises a generally orientation-independent graphical image 

depicting a function associated with the key; 

in response to actuation of the orientation key by a user white viewing content en the display, 

displaying a ptorafiry of graphical orientation marten on the display, each orientation marker corresponding 

to a respective orientation setting and graphically indicating a target top edge of the display; and 
30 in response to selection of ona of the markers by the user, clearing the plurality of orientation 

markers from the display and adjusting the orientation of the content to a setting which corresponds to 

the selected marten 

wherein the method facfitates the amity of the user to select a desired physical device orientation 
prior to selecting a new display orientation. 
35 39. The method of Claim 38, wherein the step of (fopbying a plurality of orientation markers 

contpmes tra^aying a pturajity of arrows, each arrow printing to a afferent respective edge of the display. 
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40i The method of Ctaan 391 wherein the step of displaying 8 ptorafity of arrows comprises displaying 
fern arrows. 

41. The method of Chan 40l wherein the step of dispfaymg thB four arrow comprises displaying one 
of the arrows in a fcfthfighted form to Indsate a current orientation setting. 

42. The method of Claim 38, wherein the step of displaying a plurality of orientation markers comprises 
superimposing the markers on the dispbyed content 

41 The method of data 36, whereat the step of displaying a plurality of orientation markers 
comprises positioning each marker adjacent to a respective edge of the display. 

44. The method of dan 38, wherein the step of provkfing an orientation key comprises providing an 
origirtfltffliHnrtftpftndimt fixed icon on the toucfe-sensitive (fcptsy. 

41 The method of Clam 38, wherein the baraMietd device is adapted to be placed within a cradle 
that connects to a general purpose computer, and aheren the method further comprises: 

responding to placement of the device within the cradle by automatical agisting the tisplay 

orientation from a first setting to a second setting, the second setting fscitatmg the viewing of content 

w trite the device is in tha cnufis. 

48. Tha method of Claim 4& further comprising respomfing to removal of the device from the cradle 
try restoring the orientation to tha fast setting. 
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